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(57) Abstract: A real-time glucose estimator uses a linearized Kalman filter to determine a best estimate of glucose level in real 
time. The real-time glucose estimator receives at least one measurement corresponding to glucose level. The measurement can 
be obtained with one or more sensors and is provided to the linearized Kalman filter in real time. The linearized Kalman filter 
has dynamic models and executes a recursive routine to determine the best estimate of glucose level based upon the measurement. 
Additional information can be provided to the linearized Kalman filter for initialization, configuration, and the like. Outputs of the 
linearized Kalman filter can be provided to a patient health monitor for display or for statistical testing to determine status of the 
real-time glucose estimator. The real-time glucose estimator can be implemented using a software algorithm. A real-time controller 
operating as an artificial pancreas uses a Kalman control algorithm to control glucose level of a patient in real time. The real-time 
controller receives an estimate of the patient glucose level and a reference glucose level. The estimate of the patient glucose level 
can be provided by an optimal estimator implemented using a linearized Kalman filter. The estimated glucose level and the reference 
glucose level are processed by the Kalman control algorithm to determine a control command in real time. The Kalman control 
algorithm has a dynamic process forced by the control command a cost function determining a relative level of control. The control 
command is provided to a dispenser which secretes insulin or glucagon in response to the control command to correct a relatively 
high glucose level or a relatively low glucose level. 
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METHOD AND APPARATUS FOR REAL-TIME ESTIMATION AND CONTROL OF PHYSIOLOGICAL PARAMETERS 

5 Copyright Rights 

A portion of the disclosure of this patent document contains material that is subject to copyright protection. The 
copyright owner has no objection to the facsimile reproduction by anyone of the patent document or of the patent 
disclosure as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright 
rights whatsoever. 

10 

Background of the Invention 

Field of the Invention 

This present invention relates generally to a method and apparatus for estimating and controlling 
physiological parameters and more particularly to an optimal estimator and an optimal controller for estimating and 
1 5 controlling glucose levels in a patient. 

Description of the Related Art 

Different types of sensors (e.g., optical sensors) are available for monitoring of physiological parameters 
(e.g., glucose concentration). Glucose monitoring is typically performed by people with diabetes mellitus which is a 

20 medical condition involving a body's inability to produce the quantity or quality of insulin needed to maintain a normal 

circulating blood glucose. Frequent monitoring of gfucose is generally necessary to provide effective treatment and to 
prevent long term complications of diabetes (e.g., blindness, kidney failure, heart failure, etc.). New methods of 
monitoring glucose are fast, painless and convenient alternatives to the typical capillary blood glucose (CBG) 
measurements which involve finger pricks that are painful, inconvenient and difficult to perform for long term. 

25 Optical measurement of glucose is performed by focusing a beam of light onto the body. Optical sensors 

determine glucose concentration by analyzing optical signal changes in wavelength, polarization or intensity of light. 
However, many factors other than glucose concentration also contribute to the optical signal changes. For example, 
sensor characteristics (e.g., aging), environmental variations (e.g., changes in temperature, humidity, skin hydration, 
pH, etc.), and physiological variations (e.g., changes in tissue fluid due to activity, diet, medication or hormone 

30 fluctuations) affect sensor measurements. 

Various methods are used to improve the accuracy of the sensor measurements. One method (e.g., 
multivariate spectral analysis) utilizes calibration models developed by initially measuring known glucose 
concentrations to correct subsequent sensor measurements. The calibration models become inaccurate over time due 
to dynamic changes in physiological processes. Another method (e.g., adaptive noise canceling) utilizes signal 

35 processing to cancel portions of the sensor measurements unrelated to glucose concentration. For example, two 
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substantially simultaneous sensor measurements at different wavelengths make up a compose signal which can be 
processed to cancel its unknown and erratic portion, However, many sensors do not provide substantmlly 
simultaneous measurements at two different wavelengths. 



5 Summary of the Invention 

The present invention solves these and other problems by providing a method and apparatus for making 
optima, estimates of a physiological parameter (e.g., glucose level), assessing reliability of the optimal estimate, 
andlor providing optimal control of the physiological parameter in real time using one or more sensor measurements at 
each measurement time epoch (or interval). The sensor measurements can be time-based (e.g, every five minutes) to 
10 provide continuous monitoring and/or regulation of the physiological parameter. The sensor measurements are a 
function of the physiological parameter within specified uncertainties. 

An optimal estimator provides an accurate estimate of glucose level in real time using a sensor with at least 
one output. In one embodiment, the optimal estimator is integrated with the sensor and an output display to be a 
compact glucose monitoring device which can be worn by a patient for continuous monitoring and real-time display of 
15 glucose leve.. In an alternate embodiment, the optima, estimator is a separate unit which can interface wrth different 
types of sensors and provide one or more outputs for display, further processing by another device, or storage on a 
memory device. 

In one embodiment, the optimal estimator employs a priori deterministic dynamic models developed w.th 
stochastic variables and uncertain parameters to make estimates of glucose level. For example, glucose leve. is 
20 defined as one of the stochastic (or random) variables. Dynamic mathematical models define process propagation (,.e., 
how physiological and sensor parameters change in time) and measurement relationship (i.e., how physiological and 
sensor parameters relate to environmental conditions). Environmental conditions (e.g., temperature, humidity, P H, 
patient activity, etc.) can be provided to the optimal estimator intermittently or periodically via environment sensors 

and/or data entries by a patient or a doctor. 
25 The optimal estimator uses dynamic models to propagate estimates of respective stochastic variables, error 

variance, and error covariances forward in time. At each measurement time epoch, the optimal estimator generates 
real-time estimates of the stochastic variables using one or more sensor outputs and any ancillary input related to 
environmental condition, In one embodiment, the optimal estimator employs a linearized Kalman filter to perform 
optimal estimation of the stochastic variables (e.g., glucose level). In particular, an extended Kalman filter is used to 

30 accommodate nonlinear stochastic models. 

Before making real-time estimate, the optimal estimator is initialized by providing initial values for the 
stochastic variables, error variances, and error covariances. For example, a CBG measurement or another direct 
g ,ucose measurement is performed at initialization to provide a starting value for the stochastic variable corresponding 



to 
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In one embodiment the optimal estimator provides one or more outputs to a patient health monitor which is 
capable of optimized real-time decisions and displays. The patient health monitor evaluates system performance by 
assessing the performance of the sensor and/or optimal estimator in real time. For example, the patient health monitor 
applies statistical testing to determine the reliability of the real-time estimates of the stochastic variables by the 
5 optimal estimator. The statistical testing is performed in real time on residual errors of the optimal estimator to 
establish performance measures. 

In one embodiment the patient health monitor acts as an input/output interface between the patient or 
medical staff (e.g. f a doctor, nurse, or other healthcare provider) and the optimal estimator. For example, 
environmental conditions can be provided to the patient health monitor for forwarding to the optimal estimator. 
10 Optimal estimator outputs can be provided to the patient health monitor for display or forwarding to an external device 
(e.g., a computer or a data storage device). 

In one embodiment the optimal estimator provides one or more outputs to an optimal controller which can 
regulate in real time the physiological parameter being monitored. For example, an optimal controller responds to real- 
time optimal estimator outputs and provides an output to operate an actuator. In the case of glucose control, the 
15 actuator can be a dispenser or a pump which secretes insulin to correct a relatively high glucose level and glucagon to 

correct a relatively low glucose level. The optimal controller takes advantage of a priori information regarding the 
statistical characteristics of the actuator and is able to control the output of the actuator to be within specified 
uncertainties. 

In one embodiment the optimal estimator and the optimal controller form an optima) closed-loop system. For 
20 example, a glucose sensor, an optimal estimator, an optimal controller, and an insulin/glucagon dispenser work together 

as an artificial pancreas to continuously regulate glucose level. The glucose sensor can be internal or external to a 
patient's body. The optimal controller provides a control feedback to the optimal estimator to account for delivery of 
the insulin/glucagon. 

The optimal closed-loop system is effective in a variety of biomedical applications. For example, 
25 cardiovascular functions can be continuously regulated by using sensors to detect blood pressure, blood oxygen level, 

physical activity and the like, an optimal estimator to process the sensor measurements and make real time estimates 
* of heart function parameters, and an optimal controller to control operations of an artificial device (e.g., a pacemaker) 
in real time based on the real-time estimates from the optimal estimator to achieve a set of desired heart function 
parameter values. Other artificial devices (e.g., artificial limbs, bionic ears, and bionic eyes) can be part of similar 
30 optimal closed-loop systems with sensors detecting nerve signals or other appropriate signals. 

The optimal closed-loop system is also effective in optimal treatment of chronic illnesses (e.g., HIV). Some 
medications for treatment of chronic illnesses are relatively toxic to the body. Over delivery of medication generally 
has adverse effects on the patient. The optimal closed-loop system is capable of providing effective and safe 
treatment for the patient. For example, an optimal estimator provides real-time estimates of key physiological 
35 parameters using one or more sensors, and an optimal controller controls a slow infusion of medication in real time 
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based on the real-time estimates 



from the optimal estimator to obtain desirable values for the key physiological 

I one embodiment, the optima, estimator, patient health monitor, and optimal controller are software 
algorithms which can be indented using respective microprocessor, New information regarding process 
propagation or measurement relationship can be easily incorporated by modifying, reconfiguring, andlor addmg to the 

joint algorithm or separate respective algorithms v«hioh function together to provide an optima. Cosed-loop systen,. 

Rrief Description nf the Drawings 
Figure 1 A is a block diagram of one embodiment of an estimator. 
Figure 1 B is a block diagram of another embodiment of a glucose-monitoring device. 
Figure 2 illustrates one embodiment of modeling physiological processes in a linearized Kalman fdter 

application. . 

Figure 3A describes one embodiment of an estimation function which depicts a lineanzed Kalman fdter 

formulation. 

Figure 3B illustrates an initialization in one embodiment of an optimal estimator. 

Figure 3C illustrates a time-update cycle in accordance with one embodiment of an optimal estimator. 

Figure 3D illustrates a measurement-update cycle in accordance with one embodiment of an optimal 



estimator. 



Figures 4A and 4B illustrate a first set of time history plots of optimal glucose estimates and CBG 

measurements with respect to time. 

Figures 5A and 5B illustrate a second set of time history plots of optimal glucose estimates and CBG 

measurements with respect to time. 

Figure 6A is a block diagram of one embodiment of a patient health monitor. 

Figure 6B illustrates one embodiment of a residual test data process in the patient health monitor. 

Figure 6C illustrates one embodiment of a statistical test process in the patient health monitor. 

Figure 6D illustrates one embodiment of an input/output interface in the patient health monitor. 

Figures 7A and 7B illustrate time history plots of residual test data with respect to measurement time. 

Figure 8 is a functional diagram of one embodiment of an artificial pancreas. 

Figure 9A illustrates one embodiment of an optimal controller for a closed loop system. 

Figure 9B illustrates one embodiment of a control model for a controller in accordance with the present 

invention. 

Figure 9C illustrates one embodiment of a control algorithm. 
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The present invention involves application of real-time optimal estimation, optimized real-time decisions and 
displays (e.g., a patient health monitor), or optimal real-time control to physiological processes. In one embodiment, 
the real-time optimal estimation, the optimized real-time decisions and displays, and the optimal real-time control are 
implemented as separate modules which can be combined functionally. In an alternate embodiment, the real-time 
5 optimal estimation, the optimized real-time decisions and displays, and the optimal real-time control are implemented as 
one joint algorithm. 

In one embodiment, input to an optimal estimator is provided by a physical sensor (or a plurality of sensors) 
which measures some arbitrary, but known, function (or functions) of variables or parameters to be estimated to 
within specified uncertainties and whose statistical characteristics are known. In one embodiment, an output of a 

10 real-time controller is provided to a physical controllable dispenser, or actuator, whose output is some known function 
of parameters to be controlled within specified uncertainties and whose statistical characteristics are known. In one 
embodiment, a decision and display function utilizes statistical testing of estimator residual errors using internally 
computed, and updated, estimator variances and covariances. 

In one embodiment, the present invention is implemented as a software algorithm. The present invention 

15 uses models (e.g., dynamic process and measurement models). For best performance, the models should reflect the 
latest and most complete information available. As new and more complete information is developed, performance can 
be improved through incorporation of this information by simply modifying the software algorithm of the present 
invention. 

Embodiments of the present invention will be described hereinafter with reference to the drawings. Figure 
20 1A is a block diagram of one embodiment of an estimator. The estimator uses a linearized Kalman filter. The 

linearized Kalman filter accommodates nonlinear process models and/or nonlinear measurement models. In one 
embodiment, the linearized Kalman filter is a discrete extended Kalman filter which is linearized after each update using 
best estimates. 

A general formulation of a continuous-discrete extended Kalman filter is provided in Table 1. In an alternate 
25 embodiment, the linearized Kalman filter is linearized about a nominal set for which a general formulation is given in 

Table 2. 

The estimator computes an estimator gain based on time updated and measurement updated error variable 
variances and covariances. In one embodiment, the estimator is implemented using discrete formulations. In an 
alternate embodiment, the estimator is implemented using continuous formulations. In the actual development of 
30 algorithms, one can choose a Covariance formulation or an Information formulation depending on initialization 
uncertainty considerations. Further, the use of Bierman factorization techniques (UDITT) in the implementation leads 
to numerically stable algorithms which are excellent for operation over very long time periods. 

In one embodiment, the estimator of Figure 1 A is applied to the problem of monitoring patient glucose levels. 
Any type of physical sensor which measures some function of glucose can be used. In one embodiment, one or more 
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capillary blood glucose (CBG) measurements are obtained on initialization of the estimator and when estimated glucose 

deviations exceed computed variance levels. 

,n another embodiment, additional capillary glucose values are obtained on a periodic basis to assess sensor 
function. As an example, CBG measurements may be obtained once or twice a day pre and one hour post prand,a. or 
when the estimator determines that the glucose values are out of range of predetermined limits. 

In one embodiment, the estimator is contained in a small portable package. The estimator can be operated 
by a patient. Alternatively, the estimator can be operated by medical staff in a hospital or clinic. The estimator (,g., 
Kalman estimator) uses a Kalman filter to provided real-time estimates of patient glucose levels based upon glucose 
sensor measurements. The Kalman estimator can also use additional information to more closely pred.ct t.me 
propagation of g!ucose levels, *ch as exercise, food intake, insulin administration, or other factors which influence 
gjucose levels or the function of the sensor (e.g., local pH, temperature or oxygen tension near the physical sensor). 

Figure 1 B is a block diagram of one embodiment of a glucose-monitoring device 100. The glucose-monitonng 
device 100 includes a glucose sensor 108, an ancillary sensor 110. a glucose estimator 114, and a patient health 
monitor 114. The glucose-monitoring device 100 is used to provide real-time glucose estimates of a patient 102. In 
one embodiment, the glucose-monitoring device 100 is an integrated unit which is portable by the patient 102 to 
provide continuous glucose monitoring and real-time displays. 

The glucose sensor 108 (e.g, a probe, patch, infrared, or laser sensor) is coupled to the patient 102 and 
outputsameasurementflg) which isafunction of the glucose level ofthe patient 102. The glucose sensor 108 makes 
m easurements within specified uncertainties and has known statistical characteristics. The glucose sensor 108 
provides the measurement f(g) to the glucose estimator 112. In one embodiment, the glucose sensor 108 makes 
measurements periodically. In an alternate embodiment, the glucose sensor 108 makes measurements intermrttently 
or upon command. 

The ancillary sensor 110 is coupled to the patient 102. the glucose sensor 108, and/or surroundings of the 
patient 102 and/or glucose sensor 108 to provide information regarding environmental andlor glucose sensor conditions 
|e g temperature, humidity, local P H, etc.) which affect the measurement. One or more outputs of the ancillary sensor 
110 are provided to the glucose estimator 112. In one embodiment, the ancillary sensor 110 provides outputs to the 
patient health monitor 1 14 which can process the information for display or for forwarding to the glucose esfmator 
1 1 2. In an alternate embodiment, the ancillary sensor 1 1 0 is not a part of the glucose-monitoring device 1 00. 

The patient 102 andlor a medical staff 104 (i.e.. a user) can provide information on the environmental and 
glucose sensor conditions as well as other information affecting the measurement. In one embodiment, the patient 
m and/or medical staff 104 inputs information (e.g, exercise activity, food intake, insulin administration, etc.) us.ng 
the patient health monitor 1 14. The patient health monitor 1 14 acts as an input/output interface or a means for the 
user to configure the glucose estimator 112. The patient health monitor 1 14 forwards the information to the glucose 
estimator 112. 
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In one embodiment, the patient health monitor 1 14 is a display device. For example, an output of the glucose 
estimator 112 (e.g., an optimal real-time estimate of glucose) is provided to the patient health monitor 114 which 
displays the information in a comprehensible format for the patient 102 and/or the medical staff 104. The patient 
health monitor 114 can also contemporaneously display information provided by the glucose sensor 108, the ancillary 
5 sensor 110, the patient 102 and/or the medical staff 104 which affects the measurement used to make the optimal 
glucose estimate. 

In another embodiment, the patient health monitor 114 is a status indicator. For example, the glucose 
estimator 112 provides outputs (e.g., residuals and variances) to the patient health monitor 114 which applies 
statistical testing to determine the reliability of the glucose sensor 108 and/or the glucose estimator 112. The patient 

1 0 health monitor 1 1 4 provides a warning when poor performance is detected. 

In one embodiment, the glucose estimator 1 12 is a linearized Kalman filter (e.g., a discrete extended Kalman 
filter) to account for a nonlinear process model and/or measurement model. The glucose estimator (or Kalman 
estimator) 112 provides real-time estimates of the glucose level in the patient 102. An initialization measurement 106 
(e.g., a CBG measurement) is obtained from the patient 102 and provided to the Kalman estimator 112 to initialize the 

15 Kalman estimator 112. 

Figure 2 is a flow chart illustrating one embodiment of a modeling process for physiological processes. In 
one embodiment, physiological processes are described by nonlinear stochastic models. In one embodiment, the flow 
chart of Figure 2 illustrates one method of developing a dynamic model for an optimal estimator. The method includes 
steps for state vector development, nominal dynamic/measurement model development, linearized model development, 

20 and uncertainty modeling and nominal mode! verification. 

Figure 2 illustrates modeling of physiological processes in a linearized Kalman filter application. As an 
example in glucose estimation, in a first block of Figure 2, glucose is an estimation variable. The time rate of change 
of glucose might become another estimation variable. An uncertain parameter might be the glucose sensor scale 
factor, and additionally, the rate of change of scale factor over time could be another. 

25 In one embodiment of a second block of Figure 2, the way in which variables and parameters nominally 

propagate over time may change with conditions. In the example of glucose estimation, inputs can be used to identify 
patient related activities: eating; exercising; sleeping; insulin injection; etc. With these identified patient related 
activities, additional state variables can be identified and modeled. For example, if patient eating can be related to a 
change in glucose level over some specified time interval, dynamics can be implemented within the estimator model 

30 which will propagate (or extrapolate) a rise in the glucose level over that time interval. This rise may be modeled by 
appropriate functions whose variables contain uncertainties, which may be added as elements of the state vector. In 
an analogous way, decreases in glucose levels (e.g., due to insulin injections) can be modeled. These models may be 
general in nature, or they may be patient specific. Consequently, patient related activities that have a significant 
impact on glucose levels, or the rate of change of glucose levels, can be accounted for within the dynamic process 

35 model. 
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,nsofar as sensor modeling is concerned, experience shows that, for example, infrared sensor measurement 
bias errors vary with, among other things, temperature. If this variation with temperature can be modeled, and 
included in the process model, then a temperature measurement will improve estimator performance. A particular 
physical glucose sensor may have a sca.e factor which has a characteristic decay in sensitivity over time as d,scussed 
in further detail below. There may be other variables that can be measured which will affect the physical function of a 

sensor such as local pH, oxygen tension, etc. 

In one embodiment, the nominal modeling is comprised of three types: 1) predictable characteristics of a 
physical sensor function over time (e.g.. a fixed rate in decline of sensor output), 2) other measurable physical variables 
which may affect sensor function (e.g., local temperature. pH, etc.), and 3) predictable changes in the model wh,ch 
occur with patient related activities (e.g., exercise, eating or insulin administration). Changes to the dynam.c process 
mode, may add variables and/or uncertain parameters to the state vector and changes to measurement models. As a 
result, the activities indicated in blocks 1 and 2 of Figure 2 constitute an iterative process. 

In one embodiment of block 3 of Figure 2, the relationship between variables, parameters, and measurements 
determines which parts of the processes and measurements are nonlinear and are linearized. Further, the relationship 
between variables, parameters, and measurements determines if the variables and parameters are observable and can 
be estimated. In certain cases, observability can be enhanced through introduction of additional modeling informal. 
For the glucose example, the ability to estimate sensor scale factor and/or detect sensor failure may be improved by 
modeling glucose propagation changes due to insulin injections or ingestion of sugar. For example, tracking known 
changes enhances scale factor observability through estimator generated correlations. Further, if it is known that 
glucose levels vary and the sensor measurement does not change accordingly within prescribed levels of uncertamty, a 

sensor problem is indicated. 

In one embodiment of block 4 of Figure 2, the development of a relatively large database is used to 
empirically verify and/or modify the nominal nonlinear dynamic process/measurement models and derive uncertainty 
levels associated with the variables, parameters, and measurements. In one embodiment, the empirical data can be 
fitted to nonlinear functions using a nonlinear regression package contained in a commercially available software 
application program such as "Mathematica" from Wolfram Research. Inc. Analytical functions may be added or 
modified using the test database. The repeatability of the fit over nominal ranges of the patient environment 
determines the uncertain parameters and the variations establish uncertainty levels. The more accurate the dynam.c 
process and measurement models, the more the uncertainties are reduced, and the greater the estimator performance. 
As the process evolves, the modeling becomes better defined through iterations between blocks 4 and 2. Certam 
portions of the models may be developed on an individual basis {e.g., for a specific patient). 

A database is used to empirically develop and verify models. An embodiment discussed below uses the 
database to develop two separate dynamic process models. For example, after processing a number of data sets from 
a physical sensor that was used to monitor the glucose level of various patients, it was observed that the sensor scale 
factor was equally likely to move up or down over the first fifteen to twenty-five hours. However, the scale factor 
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tended to decay for the remaining life of the sensor after this period of time, usually three or four days. These 
observations are incorporated in an embodiment of the estimator discussed in further detail below. 

Figure 3A describes an estimation function which depicts a linearized Kalman filter formulation, in one 
embodiment, the particular form is that of a discrete extended Kalman filter which linearizes after each update using 
5 best estimates. In the formulation, a vector whose elements comprise variables and/or parameters (with uncertainties) 
for making estimates defines the state of a system. 

There is a distinction between variables (e.g., random variables) and parameters with uncertainty. Variables, 
such as glucose and rate of change of glucose, are estimated and can be controlled [if control is implemented). 
Parameters with uncertainty are part of the model structure not known precisely and are estimated and updated (like 
10 variables) but not controlled, e.g., a glucose sensor scale factor or insulin dispensing controller scale factor. 

In one embodiment, real-time variable and parameter estimates are used to re-linearize the model following 
each update. Inputs to the estimator can consist of any measurement which is related to, or can be correlated with, 
any element in the state vector. In the case of glucose estimation, other inputs can consist of dynamic process 
configuration control based on patient related activities or other circumstances. Following initialization, the time 
15 update and measurement update cycles form a recursive loop. The time update period is the time interval between the 
receipt of measurements. This is a function of the sensor and of acceptable latency in the estimates. 

Figures 3B, 3C and 3D illustrate, respectively, Initialization and the recursive Time Update and Measurement 
Update cycles according to one embodiment of the present invention. Table 3 defines, in more detail, symbols used in 
these figures. In one embodiment, dynamic process and measurement modeling is contained in software algorithms 
20 with parameter and structure updates in real time. 

One embodiment of an initialization of the estimation process is described in Figure 3B. A state vector 
estimate, Xeo, contains the initial estimates of the process variables and model parameters with uncertainty, while the 
covariance matrix, Po, contains the initial variances and covariances associated with the Xeo elements. 

Figure 3B shows an example embodiment with a two-element state vector which is based on empirical 
25 observations described above. As an example, the point in time when the scale factor begins to decay was chosen as 
20 hours, a nominal value over the database. An exponential decay was chosen to model this decay rate and is 
consistent with the first derivative of scale factor equal to a parameter, alpha, multiplied by the variable scale factor. 
In this case, alpha is not modeled as an uncertain parameter; a value of 0.012 was chosen as a nominal value, over the 
database, for the five-minute cycle time of this physical sensor. 
30 The initial estimate of glucose is 1 50 mg/dl (state vector element) with an initial uncertainty variance of 1 00 

mgfdl squared (a covariance matrix element). When processing the data, the glucose element was initialized by setting 
it substantially equal to the first capillary blood glucose measurement. The nominal initial scale factor value, for the 
physical sensor, is 0.25 nano-amps/(mg/dl) with a parameter uncertainty (variance) of 0.1 nano-amps/(mg/di) squared. 
The initial covariance between the glucose variable and the scale factor parameter is zero. Correlation 
35 between glucose and scale factor will develop as the estimator processes the sensor measurements. Each type of 
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sensor will have its own model and characteristics. The measurement uncertainty is 5 nano-amps squared, an element 
of the R matrix. In one embodiment, this is a scalar measurement and the R matrix contains a single element. 

A second measurement in this example embodiment is an occasional direct measurement, such as a capulary 
blood glucose measurement (CBG), with a unity scale factor, and a measurement error uncertainty of 1 5 mg/dl squared 
(a single element in a second R matrix). This is probably better modeled as 15% of the measured glucose value. The 
growth in uncertainty of glucose and scale factor from measurement to measurement is, respectively, 20 mg/dl 
squared and 0.002 nano-amps squared (elements of the process noise matrix, Q). 

Figure 3C illustrates a time-update process of the recursive process in one embodiment of an optimal 
estimator. In this figure, a negative superscript indicates a time update while a positive superscript indicates a 
measurement update. In the brackets, a letter T indicates time at the ith interval and (i-1) indicates time at the 
previous time interval. In an update process, a state vector is first updated since these elements are used to update 
matrices and to bring the time epoch of the estimated measurement to be consistent with that of the next 

measurement to he received. 

In an example embodiment with a two-element state vector, the dynamic process is linear. With no patient 
inputs, the first derivative of the measured physiologic variable is zero, corresponding to the case when the level (on 
average) is as likely to either go up or to go down. No additional a priori information is assumed about the time 
propagation of glucose. 

In one embodiment of estimating glucose, the solution to the scale factor propagation after the first 20 hours 
is defined by the exponential shown in the second column. Consequently, for this embodiment, the dynamic process 
20 function (f), is linear, is not a function of state vector elements, and, from linear system theory, the transition matrix 
(A) is the 2 by 2 identity matrix for the first 20 hours and thereafter is defined by the 2 by 2 matrix in the second 
column. 

In one embodiment, the measurement function (h) for the sensor measurement is non-linear in the state 
vector elements. If Ge and Se are used to denote glucose and scale factor estimates, respectively, then Ye=Se*Ge. 
25 Definitions of the above terms are provided in Table 3. When linearized using best estimates, the linearized 

measurement matrix H - [Se Ge] and is of the same functional form both before and after 20 hours. 

Figure 3D illustrates a measurement-update process of one embodiment of an optimal estimator. The 
measurement update sequence begins with the computation of the gain matrix, K(i). The difference between the 
actual censor measurement and the best estimate of the measurement is computed: y(i) - YmfO - SeTGeW. Th.s 
30 difference, or residual, when multiplied by the gain matrix and added to the time-updated estimate produces the 

measurement-updated estimate. 

The covariance matrix is then measurement updated, reflecting the level of uncertainty in the estimates 
following the processing of a measurement. In the glucose example, if a second measurement is available, such as a 
CBG, then the measurement sequence is again cycled through, starting with a new gain computation, and using the 
35 appropriate measurement matrix and new best estimate of the next measurement. Following the processing of all 
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available measurements at the ith time epoch, the updated state vector and covariance matrix are then used to start 
the time update for the (i+ 1 )th time epoch which begins the next cycle. 

One embodiment of an estimation algorithm illustrating the initialization, the time update process, and the 
measurement update process discussed above is provided in Table 4. Table 4 is an algorithm programmed in the 
5 MATLAB language (from Math Works). This printout defines a working program and has been used to process a 
significant number of data sets. In the glucose example, the estimation results from the process of two data files, 
both gathered from the same patient, and taken about a month apart, are shown in Figures 4A, 4B, 5A, and 5B. 

In one embodiment, sensor inputs are provided and processed every 5 minutes. Occasional CBGs are also 
provided. For example, two CBGs per day were processed by an estimator; and additional CBG values were used to 
10 judge estimator performance by comparing glucose estimates with actual CBG values not used by the estimator. 

Figures 4A and 4B illustrate a first set of time history plots of optimal glucose estimates and CBG 
measurements with respect to time. Figure 4A shows a time history of the real-time estimates of glucose (e.g., every 
5 minutes) along with all available discrete CBGs. 

Figure 4B shows a time history of the glucose estimates along with CBGs that were processed. In this 
15 figure, the estimated glucose value took several rapid swings between approximately 48 hours and 58 hours. Figure 

4B indicates that only sensor measurements were processed during that interval and no CBGs were processed. 
However, the CBGs plotted in Figure 4A indicate that the glucose estimates did tend to follow the excursions of the 
patient glucose levels. 

Figures 5A and 5B illustrate a second set of time history plots of optimal glucose estimates and CBG 
20 measurements with respect to time. The time duration for these runs is about 4 days without patient inputs. Over 
this time period, the patient ate, slept, exercised, and took insulin injections. Dynamic models to account for these 
activities, much like the decaying scale factor, could be implemented and called into use upon command. 

Figure 6A is a block diagram of one embodiment of a patient health monitor. On example of an algorithm for 
the patient health monitor is in Table 4 which generates statistical test data based on Kalman filter residuals as well 
25 as test displays. In one embodiment, the patient health monitor generates real-time decisions and displays which are 

integrated with a Kalman filter. The patient health monitor allows the patient or medical staff to interact with a 
Kalman estimator and/or Kalman controller described herein. 

In one embodiment, the patient health monitor provides insight into how well a Kalman filter is working 
through the filter residual that is the difference between the estimate of the measurement at the time the 
30 measurement is received and the actual measurement. In another embodiment, other checks are used from time to 
time, such as the CBGs in the glucose example described above. An example of another check on the status of a 
sensor is through the use of patient inputs or signals indicating that something is changing in a prescribed way and 
then noting whether or not the sensor is observing this change within prescribed uncertainties. 

In one embodiment, the real-time displays and decisions of the patient health monitor uses some occasional 
35 outside checks but relies substantially on results of statistical testing performed on filter residuals. If estimates of the 
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measurements are, on average, good (e.g., residuals are small and unbiased), then the estimator is generally working 
well, and vice versa. More specifically, elements of the covariance matrix can be used to construct statical test 
applications. 

For hospital applications, real-time displays of glucose estimates along with real-time displays of est.mator 
performance test results can be important visual inputs to the medical staff. Requests for additional CBG 
measurements or the sounding of an alarm in the event glucose estimates exceed critical limits may also prove useful. 
In one embodiment, a reduced number of outputs is provided in relatively small estimators for individual use. 

Figure 6B illustrates one embodiment of a residual test data process in the patient health monitor. For 
example the residual (y), covariance matrix (P), measurement matrix |H), and measurement noise matrix (R) are 
available from an estimator algorithm at each time epoch (i). If the estimator is operating properly, the sequence of 
residuals has the property of zero mean, white noise sequence. i.e., any two residuals taken at different times are 
uncorrelated (E[y(r V (j)] - 0, for all j not equal to i). This condition provides a unique means for construing 
statistical tests. 

Visually, a time history plot of the residuals, Sy(i) in Figure 6B, should appear random, zero mean, and 
unbaised. If they are summed over time, the deviation of the sum from zero should, on average, grow as the square 
root of time, as should its absolute value, ASyO). The fact that E[y(i)»y(j)l - 0, for i not equal to j, also means that the 
sum of the variances. SV(i) in Figure 6B, which is easily computed, is equal to the variance of the sum of residuals for a 
properly performing estimator. The standard deviation of the sum of residuals, StdSV(i) also grows as the square root 
of time. 

Figure 6C illustrates one embodiment of a statistical test process in the patient health monitor. Figure 6C 
defines statistical tests which can be constructed based on filter residual test data. One of these compares the 
absolute value of the sum of the residuals with the standard deviation of the sum of residuals. On average, the ASy(i) 
should be bounded by the StdSV(i). If not, this indicates that the deviations of SylO are growing faster than that of a 
white noise sequence, implying degraded estimator performance. 

Real-time displays of ASy(i) and StdSVfi) histories can provide a visual picture of estimator performance. An 
example is provided in Figures 7A and 7B which illustrate time history plots of residual test data with respect to 
measurement time. These two plots are one form of residual tests for the two sets of glucose estimation results 
provided in Figures 4A, 4B, 5A, and 5B respectively. In both cases, the sum of residuals are well behaved and was 
bounded by the Standard Deviation, Std, of the sum of residuals. 

The example embodiment for the glucose application of test data, test generation, and test result display 
described above is implemented by the algorithm in Table 4. Other real-time quantitative tests can also be constructed 
using these data. Tests on individual residuals can be performed using individual variances. If a measurement is 
received which causes the residual to exceed a four signal level, for example, the action might be to emit a warning and 
request an immediate CBG measurement. Other tests are identified in Figure 6C and will be evaluated as the system 
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Figure 6D illustrates one embodiment of an input/output interface in the patient health monitor. The patient 
health monitor provides a capability for the patient and/or staff to communicate and interact in real time with 
estimation and control processes using simple commands, visual displays, and audio outputs described above. 
Confidence levels in estimator performance can be established and a genuine interface established whereby the 
5 estimation and control processes could request additional information to check and insure confidence in estimates, 
physical sensors, and physical controllers. The staff can provide useful real-time inputs to augment this process. 

Figure 8 is a block diagram of one embodiment of a Kalman optimal stochastic control solution as applied to 
physiological processes, in one embodiment, the application includes both optimal stochastic regulator and optimal 
stochastic tracking control solutions. Tracking control involves a controlled variable following a reference value, 
10 constant or dynamic, as closely as possible. Control is applied to physiological processes, wherein a control gain is 
computed based upon optimization criteria which minimizes controlled variable errors while minimizing application of 
control based on cost weightings. 

There is a duality between the computation of a Kalman estimator gain and a Kalman control gain. The 
Kalman estimator gain minimizes estimation error variances. The Kalman control gain minimizes variances of error 
15 between the controlled variables and the reference variables while minimizing the level of control applied. As a result, 
the optimal control function includes specification of the controlled variables and their associated costs as well as 
costs associated with the amount of control to be applied. For example, smaller control variable error costs and larger 
control application costs will allow the controlled variable to deviate farther from the reference, but with reduced 
application of control. 

20 In one embodiment, linearization techniques described above in association with the Kalman estimator is 

applied to physiological nonlinear stochastic processes. For example, linearization about nominal values or about best 
estimates are provided by the Kalman estimator. Uncertain parameters associated with a controllable dispenser, or 
actuator, are included in an estimator state vector. 

The optimal stochastic controller can use linear or nonlinear formulations and discrete or continuous time 

25 formulations. In one embodiment, the optimal stochastic controller is used with an optimal estimator described herein 

and/or an optimized decision and display function also described herein to form a closed loop system. The closed loop 
system works as an artificial pancreas when applied to a glucose problem in one embodiment. 

Figure 8 is a functional diagram showing a controllable dispenser, or pump, with the capability to secrete 
insulin and glucagon to control high and low glucose levels, respectively. In one embodiment of a closed loop system, 

30 an estimator and a controller share a state vector wherein the estimator estimates it and the controller controls 
designated elements of it. Unlike the estimator, the time varying gain computations for the controller is 
computationally intensive and may not be used in all applications. The controller includes time varying or steady state 
gain formulations. 

Figure 9A illustrates one embodiment of an optimal controller for the artificial pancreas. The glucose control 
35 problem is a tracking problem since the glucose level is controlled to a desired level which may either be constant or a 
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function of time. In one embodiment, the dynamic process model includes a quantitative description of how glucose 
levels propagate, in time, as a function of insulin/glucagon secreted by the controllable pump. The dynamic process 
model is described by a system of first order differential or difference equations. Excluding the pump, much of the 
modeling for the glucose control is available through the estimator modeling development. 

Figure 9B illustrates one embodiment of a control model for a controller. In an example embodiment, the 
dynamic process model is described by three first order differential equations that are forced by a control variable, u. 
The dynamics of this process include a first order time lag and a scale factor associated with the pump, and a first 
order time lag and a scale factor associated with the physiological process. The model for the glucose sensors is the 
sameasintheexampleglucose estimator embodiment. In the definition of the elements of the transition matrix, alpha 
g s and d are the inverse of the first order time lags associated with glucose, glucose sensor scale factor, and pump, 
respectively. Beta g is the glucose scale factor multiplied by alpha g. Delta t is the time interval between 
measurement/contro. application epochs. The controlled error is the difference between the estimate of glucose 
(provided by the estimator) and the glucose control point input. 

In a controller command. Beta d is a pump scale factor multiplied by alpha d. The measurements are the 
same as for the example glucose estimator, except that the measurements contain an additional zero since the 
measurements are not functions of the variable insulin/glucagon. 

The cost function, which is minimized by the optimal stochastic control, contains costs associated with the 
g,ucose errorand the application of control. Choosing a value of Cu that is much larger than Cg will result in a relative 
gentle application of control. Another example embodiment would utilize a higher order model in wh,ch the f,rst 
derivative of glucose would be included in the state vector, and included as a control variable. If a relatively large cost 
is associated with the first derivative relative to the glucose control point error, then the control will be very act.ve 
when rapid changes in patient glucose occur while relatively gentle otherwise. Other example embodiments would 
include pump scale factor as a state vector element (uncertain parameter) as well as insulin/glucagon measurements to 
the estimator. 

Figure 9C illustrates one embodiment of a control algorithm based on the model defined in Figure 9B. Using 
either a time varying gain or a pre-computed steady state gain, control is applied at each epoch based upon a 
difference between an estimate of a patient glucose level and a glucose control point. A control, u, is applied to a 
pump over each time interval, and a state vector is time updated es indicated in this figure using the control variable, u, 
as a forcing function. Other time updates are performed in accordance with embodiments discussed above m 

association with estimator equations. 

A potential problem in the application of closed loop control to that of physiological processes is due to 
potentially long time delays that may be de-stabilizing. These delays can be in the form of transport lags. A transport 
lag is the time between when control is applied and when the process action begins. An optimal technique for control 
using delay states is discussed in "Optimal Control of Linear Stochastic Systems with Process and Observation Tune 
Delays" by E. J. Knobbe (Academic Press, Inc., 1989) and is hereby incorporated herein in its entirety by reference 
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thereto, A discussion of principles developed for optimal control with process and observation time delays is provided 
in Table 5. 

Although described above in connection with particular embodiments of the present invention, it should be 
understood that the descriptions of the embodiments are illustrative of the invention and are not intended to be 
5 limiting. Various modifications and applications may occur to those skilled in the art without departing from the true 
spirit and scope of the invention. 
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TABLE 1 

SUMMARY OF CONTJNUO\J^DlSCRCTE 
EXTENDED KAiMAN FILTER 


Meawtcmcnt Model 




Imttf] Condons 
Otho AKumatJow 




Propagation' 
End Covariancc 




State Estimat* Update 

Eiror C ©variance 
Update 

Gain Matrix 


■ Sc(-) + KfctsHflc <&(-)>) 


Definitions 
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SUMMARY OF CONTINUOUS-DISCRETE 
LINEARIZED KALMAN FILTER 



System Modal 
Measurement Model 




Initial Conditions 
Other Asiumptions 


E[>K(t) J3c T ) = Ofm all k andan t 
Nominal trajectory 3(0 Is avaDable 


State Ertirtate 
Propagation 

Error Covftriancs 
Propagation 


i(t)=iS(0,t)+P<x(t) t t)tx(t)-S<OI 
P(t)= F(S(0.t)P(0+P(t)FT(7(t),t)+<Kt) 


State Estimate 
Update 

Error Co^ariancc 
Update 

Gain Matrix 


P lc ( + ) = [l-K k H k g(t^)]P k (-) 

Kk=Pk(-)H k T(x(tk)> IH^tJcWPkC^HlcT^i^+RjJ- 4 


Definitions 


& i (t> |x(t)-T(t) 
* iXk) U(tk>"2(tk) 
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TABLE 3 



l£ e S • These symbols denote, respectively, the state vector, the best estimate (or optimal 
SSSS and the initial best estimate of the state vector. They contain both vanables 
andTaSneters asTefined above and, with regard to estimation, there are no distinctions. 

d ^^r^Xe') : These symbols denote the time derivative of the state vector and estimated 
Si vSr' SeSeiy. They rep^sent a system of first order differential equations (or difference 
SSSSSSJe the manner in which the state elements propagate in tone. The function, f, may 



be linear or nonlinear. 



^Sfe^(Xe) : These symbols denote the actual measurement and me best estimate of &e 
measurement reLctively. The function, h, defines the arbitrary, but known, way in which the state 
related to the measurement, and e represents the sensor measurement error. 

^^ffrespectively, the matrix of variances and co-variances associated with the errors of each 
of Sate variable estimates f (within the estimated state vector) and their initial values, 

A^A^T^S the transition matrix, which is used to propagate the covariance matrix fo^ard it time 
^ uidaSld it's initial value, respectively; in the linear case it is also used to time update the state 
vector estimate. 

f^SoSSelrSx of variances and co-variances associated with error growth uncertainty 
accumulated in the state variable estimates since the last measurement update, 

g^^ot^e measurement matrix and it's initial value, respectively This matrix defines the 
ffS ehihip between the measurement and the state vector elements. If, the "easement 
US ta£S tLn H = h; if h is non-linear, then H is defined by linearizing h using partial derivatives 
or perturbation techniques. 

g?g™fS^anances and co-variances associated with measurement error uncertainties. 

K-Dltes^S ian gain matrix which, when multiplied by the difference between the actual 
L^—randTe b£t estimate of the measurement, yields the estimated state correction This 
S * correction, when added to me old best estimate, becomes the new best estimate. 

Lavement This difference multiplied by the Kalman gam yields the correction to the previous state 
vector estimate. 
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TABLE 4 

% Optimal Glucose Estimator, Extended Kalman Filter; Computes Statistical Test Data for 
Patient Health Monitor 

%Ed_JYPJEstimator; Two-step scale- factor model, Exp = .999 for t>20; r=l5~2 for y<10 ; 

x=[150;.25J ; hh=fl 0};p=[100"2 0 ; 0 -l*2];a=[l 0 ; 0 1) ; q=[20*2 0 ; 0 .002*2); rr= 1S*2; 
r= 5*2; I=[l 0;0 1] ; 

load EdJY528.prn r 

[m, n] -size ( Ed JY528 ) , 

t=EdJY528(:,l)/12; 
y=EdJY528<:,2) ; 
g=EdJY528(:,3) ; 
gm=EdJY528<:,4) ; 

x=[gm<l);.25]; 
sz=0.0; 

SVZ = p(l,l)*x(2)~2 + p{2„2)*x(l)~2; 

for i = l:m; . . „ 

r = 5*2;. ... 
zz — 0; . . . 

if y(i) < 10 

r = 15*2; . 

end; 

if t(i) > 20 a~[l 0 ; 0 .999];... 

end; 

p=a*p*a'+q; . . . 

if gm(i) > 0 

k=p*hhV (hh*p*hh , +rr) ; . . . 
zz=(gm(i>-x(l));... 
x=x+k*zz; . . . 
p=(I-k*hh)*p;... 

end; 

h=[x(2) x(i)];... 
k=p*hV(h*p*h , -fr);.., 
z=(y(i)-x(l)*x<2));,.. 
x=x+k*z; — 
p=(I-k*h)*p;.., 

. az=abs (z) ; 

asz =» abs (sz) ; 

*.VZ = p(l,l)*x(2)*2 + p(2,2)*x(l)*2 + 2+p(l,2)*x(l)*x(2) + r ;... 
sigZ = sqrt(VZ);... 

SVZ = SVZ + VZ; 

sigSZ = sqrt(SVZ);... 



VZZ - p(l,l) + rr>... 
sigZZ = sqrt(VZZ); 
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azz = abs (zz) ; • - • 

xhistory (i,l) =x(l);--. 
xhistory (i, 2) - x(2) ; . 
gmhistory =gm; — 
ghistory ^g; ■ - • 
zhistory(i) =z;*.. 

sigsz_history(i) = sigSZ;.-. 
sigz_history(i) =2*sigZ;... 
aszhistory(i) - asz;... 
azhistoryti) = az; . . - 

zzhistory(i) » zz;-.- 
sigzzjiistory(i) = 2*sigZZ;.-. 
azzhistory(i) = azz;.-. 

sigjiistory (i, 1) =sqrt (p (X, 1) j [ ? • • - 
sigjiistory (i, 2) =sqrt(p( 2, 2) ) } . . - 

yhistory=y; . . . 



end; 



figure (1) 

plot (t, xhistory U,2>); 

vl abel ( ' Measurement Time (hrs) ), 

Sabel ( - Scale Factor Estimate; (ISIG Units/ (mg/dl) 
title { 'Scale Factor Estimate vs Time ); 

figure (2) ... 

plot (t r gmhistory ( : ) , t, xhistory ( : , 1) ) / 

xlabeK'Time (hrs) 1 ) ; fw#f/f ,,Mv. 

Slabelt 'Glucose Meas a Estate* Time .,; 

title (' All Glucose Measurements & fcstimateu ^xuo 

figure (3) 

plot (t , yhistory ( : ) , t, zhistory ( : ) ) ; 
xlabeK'Time (hrs)'); n , 

Ylabel I ' ISIG Meas & z Residual ; (ISIG Units ) U 
title ('ISIG Measurement & z residual vs Time ), 

figure (4) 

plot ( t p xhi story (: , 1 > , t , ghistory ( : , 1 ) ) , 
xlabelC Time (hrs)'); 

vlabel ('Glucose & Estimated Glucose; (mg/dl) ), 
Stle ('Glucose Estimate t All Glucose CBGs vs Time'); 



figure (5) , 
plot(t,sigzz_history(:} , t, azzhistory ( : ) ) , 

xlabelCTime (hrs) 1 ); f - nM . 

vlah^lfAbstzz) Residual & two sigma(zz); (mg/dl) ) r 
SSe(> R Sdual Test: 2 SigmaUz) « »>.<«) Residual vs Time" 



figure (6) 

plot ( t, azhistory ( : ) , t, sigzjiistory { : ) ) ; 

xlabelC Measurement Time (hrs)'); unit-on- 
ylabel ('z Residual & Standard Deviation; ISIG Units) ), 
title ('Residual Test : Abs(z) & 2 Sigma(z) vs Time ), 

figure (7) 

plot ( t, aszhistory ( : ) , t , sigsz_history ( : } ) ; 

xlabel ( ' Measurement Time (hrs) ' ) ; 

ylabel (' sz Residual & Sigma; (ISIG Units > ; 

title ('Residual Test : Abs(sz) & Sigma(sz) vs Time ), 
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TABLE 5 



PROBLEM DEFINITION 

The general, discrete-time system representation with explicit process and 
observation time delays is given by 

x(k + I) - t AtWik + ! - 0 + B(k)V(k) + W t (k) f (I) 

Y(k) m t t Cj(k)X(k +!-;)+ W 2 (k\ (2) 

where p and q are integers > 1; W t and W 2 are zero-mean white-noise 
sequences such that 



E{W x (k)W*(k)} = V x (kY 
E[W 2 {k)Wl(k)} = V 2 (k) 
E{W t (i)WHj)} = 0 



Y is an m x 1 observation vector; X is an n x 1 random state vector whose 
initial uncertainty is uncorrelated with W, and W 2 and with initial covariance 
g 0 ; and V is the control input vector. The objective is to find the control 
function (functional) U(k) for k =* 1,2,... that minimizes an expected qua- 
dratic cost function for the linear stochastic regulator defined by Eqs. (1) and 
(2). Because linear stochastic tracking problems can be formulated as linear 
stochastic regulator problems by combining the reference and plant models 
in an augmented system [3], this system representation applies equally to the 
tracking problem. 



PROBLEM FORMULATION 
AND SOLUTION 

The system representation defined by Eqs.(l) and (2) can be cast in 
stochastic regulator form by augmenting the state vector with the time- 
delayed states, that is, 

Xik + 1) = A{k)X (k) + B[k)V(k) + WM (3) 

and 

Y(k) = Qk)X(k) + W 2 {k) (4) 
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A{k) & 



0 / 0 
0 



0 
AM 



0 

0 / 

<4,(*)J 





■ 0 " 




' 0 


B(k)± 


0 




0 




»(*>. 







c{ky & 



X{k ~h+\) 
X(k-h + 2) 

X{k- 1) 
X{k) 



C„{k) 

C,'(k) 
. C,(k) 



and the dimensionality or the system is defined by h, where h = max(p,«»). 

states cannot be changed or controHed. In Eq. (4, the observat.on Y and the 
observation noise W 2 also remain unchanged. 

In Eos (1) and (2), p and q arc not, in general, equal For example, n inc 
ob^em, o^is no, aVnear function of all the delayed states coined .» * 
then h - a > v and the appropriated - p)subroatnces in C.of £«.|4).a« set 

rdc^aLdinjf.then. = , > *and the appropriate 
Fn f 34 are set equal to zero. The dimensions of B and W, , in Eq. (3), must a so 
with the integer h. Therefore, without loss of general,.* Uk 
TysZ I defined by Eqs. ( 1 ) and (2) can be represented by the augmented system 

m otn e ^S 
function of the form, 

[X(t) T RiWJ?(fe) + U T (ft)R,(*)lW)] + < 5 > 

then the separation principle applies [3]. Also, the optimal linear stochasUc ■ 
conuol of the augmented system is given by a deterministic, opt »nal linear 
ZSSS&J* input X (or estimated sute 

by an optimal one-step predictor using the augmented model [4]. That is, 
V(k) = - F{k)X[k): k = *„ , k 0 + 1 fc„ W 
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where the control gain F satisfies 

F(k) = {R 2 {k) + *W*«(* + 1) + P(k + nmVWKRik + 1) 

+ P(*+1EM(*); (7) 
the matrix P satisfies the recursive matrix Riccati equation, 

P(k) = TOc*,^ + i) + p(* + Utffc).- %)W3; W 

the one-step predictor output X is defined by 

1(* + I) = ,4<*)X(*) + *(*)!>(*) + K(k)LY(k) - C(k)X(k)]; (9) 

the estimator gain K satisfies 

K(k) - >fWGWC T W[C(fc)QWC T W + ^wr 1 ; (10) 

and the state estimation error covariance matrix Q satisfies the recursive 
matrix Riccati equation, 

Q(k + 1) = lA{k) - K(k)C(/c)]eW>T(/c) + ?,(*). (1 1) 

The final value of P used to "initialize" Eq. (8) (which is solved backward in 
time) is the final value defined in the quadratic cost function of Eq. (5), that is, 
P(*i) = K The initial value of Q used to initialize Eq. (11) is the error 
covariance of the initial estimate of AT, that is, g(0) = Q 0 . 

If the system statistics defined in Eqs. (1) and (2) are gaussian, then the above 
solution is the optimal solution without qualification; if not, then it is the 
optimal linear control solution. The expected system performance is deter- 
mined by analyzing the augmented system as a linear, stochastic regulator 
problem. 

PRACTICAL APPLICATIONS 

From control gain Eqs. (7) and (8) and estimator gain Eqs. (10) and (11), it 
can be shown that the required dimensions of the controller and estimator are 
not, in general, equal. The dimensions of the control matrix Riccati equation 
(8) is determined by the number of delayed states in the process evolution, that 
is, P has the dimensions of n • q x n • q. Consequently, for the special case of 
measurement delays only (q = IX the controller implementation is unaffected. 
However, the dimensions of the estimator matrix Riccati equation (11) are 
determined by the maximum of p and q. Since h = max(p,gX then Q has the 
dimensions n • h x n • h. For the general case, the optimal control is given by 

02) 
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where 

F(k)±iF q (k) F^ t (k) - F 2 (k) F,(lc)], (13) 

and 

(14) 

We note that, in Eq. (14), X(*) is the one-step predicted value of the original 
system state vector; X {k - 1) is the filtered value; X{k - 2) is the one-step 
smoothed value; and, finally, X{k + 1 - h) is the (h - 2)th smoothed value. 

Typically, the real-time computational requirements associated with the 
implementation of time-varying optimal control are always stressing due to 
the "backward-in-time" recursion that is required to obtain solutions F of 
Eq. (8). However, in many high-accuracy applications, the A, B, K„ and R 2 
matrices of the augmented system and cost function can be treated as time 
invariant over the time intervals of interest. Further, if the augmented system 
satisfies the relatively minor requirements of stabilizability and detectability, 
then the control gain F will converge to a unique value such that the steady- 
state optima! control law is time invariant, asymptotically stable, and mini- 
mizes the quadratic cost function of Eq. (5) as k x - oo. For this case, the 
steady-state gain matrix F„ can be computed off-line and stored for real- 
time use; the real-time computations required to implement this steady-state 
control law are negligible. 

Usually, for tracking and regulator problems, the steady-state control 
gains and time-varying gains are such that the initial value of the time-varying 
gain is equal to the steady-state gain but is less than or equal to the steady-state 
gain as time progresses, that is, 

F a £ F(k) for fc 0 <fc£*i. 

As a consequence, the steady-state gain tends to maintain the controlled state 
closer to the estimated state, but at the cost of control energy. If accuracy is the 
significant criterion, then the steady-state gain is not only easy to implement 
but also provides essentially equivalent or better accuracy. 

This, however, is not the case for the estimator gain, even though in most 
cases where linear steady-state optimal stochastic control is implemented, 
both the steady-state control and the estimator gains are used. For the es- 
timator, and the same general conditions as before, the initial time-varying 
estimator gain is usually significantly larger than the steady-state gain, to 
account for initial uncertainties in the knowledge of the system state. As time 
progresses, the time-varying gain converges to the steady-state gain, that is, 

*„<*(*) for fco 
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Consequently, initial system performance is significantly degraded if X„ is 
used. In fact, if applied to a linearized" system, the estimator can actually 
diverge given the initial small steady-state filter gains. 

Hence a good compromise between performance and computational 
complexity is to choose the steady-state controller with the time-varying 
estimator. Further, because the estimator matrix Riccati equation is solved 
forward in time, the computations associated with the time-varying filter gain 
are orders of magnitude less than with the time-varying control gain and can 
usually be implemented in real time. 

Although the computations associated with the augmented system es- 
timator are significantly increased because of the increased dimensions, some 
simplifications can be made. The estimator Riccati equation can be separated 
into a time update and a measurement update, where the time update for the 
augmented system becomes primary one of data transfer. If Q, from Eq. (1 IX 
is defined as 



GW« 



GuW Q u2 (k) 



&.*(*) 



(15) 



.GuM Gm«J 

then, for the special case where q - 1 and p > 2, the time update becomes 
Gu(* + = 1 



e*,(fc + 1) - AMQpJkyAjik) + v x (k) 

For the worst case, where q > p > 1, the time update is given by 
Qtjk + 1)« Qi+tj+M U= 1,...,*- lp 

<?..<(* + l) « t Gf.#HV«)-#X ' - - U 



(16) 



(17) 



In practice, another computational simplification results because rarely, if 
ever, is the actual system measurement a function of every time-delayed state 
element, and likewise for the actual system process model Hence the 
submatrices A % and C, (for i > 1) in A and C, respectively, are usually of 
significantly reduced dimension. This, in turn, significantly reduces the 
dimensions of the augmented system mode). 

We note that the iteration interval At (implied in the discrete-time system 
representation) or some integer number of AC. s should be set equal to the time 
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delay. For variable time delays, it may be advanUgeous to »*(a gamble 
iteration intervals for the estimator, (b) fixed iteration intervals for be 
conSr an^(c)variable-.imeupdatesofthestateestima.eto time synch the 

estimator output with the controller input nation 
Finally, for the analogous continuous-tone problem, the filter equation 
becomes a partial differential equation with a boundary condition, and ^the 
^variance equation becomes a partial differential matrix equat.on with three 
bounda" Tclditions (see [2]). Consequently, the most practical control 
solution isobtainedbydiscretizingthecontmuous-timesystcmrepresema^ 

and then applying the approach of Section III. One techn.que ^ 
the continuous-time representation is by usmg the Z transform ™J°*£* 
for exampIe,[5].UsingascaIar differentia! equation with one delayed state as 
an example, we have 

X(t)= t fl| X(f-iAl) + l/(t). 08) 

If we assume that the output solution X(t) is sampled in discrete time, and if 
the system processcan be reasonablyapproxima.ed by a continuous sys, ^ 
which X is driven by the output of a high-frequency sampling of the ngh! s.de 
of Eq. (18), then the discrete-time process model is given by 

X{k + I) = (1 + fl 0 Af)X(Jt) + (a, At)X(k - At) + (Ar)U(fc). (19) 
The approximate discrete-time solution to Eq. (18), which is given by 
Eq. (19), is now in a form consistent with Eq. (1) of Section II, and the ap- 
proach of Section HI can be applied. 
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WHAT IS CLAIMED IS : 

1 . A method for providing a best estimate of glucose level in real time comprising the acts of: 

obtaining a measurement which is a function of glucose level, wherein noise associated with the 
5 measurement is within limits of a predefined measurement uncertainty; 

supplying the measurement to an extended Kalman filter in real time, wherein the extended Kalman 
filter has a dynamic process model, a dynamic measurement model, a state vector with at least one element 
corresponding to glucose level, and an error covariance matrix of the state vector; and 

determining the best estimate of glucose level in real time using the extended Kalman filter. 
10 2. The method of Claim 1, wherein the extended Kalman filter is implemented using a software 

algorithm. 

3. The method of Claim 1, wherein determination of the best estimate of glucose level in real time 
uses a recursive process comprising the acts of: 

computing a current estimate of the state vector using a preceding best estimate of the state 
1 5 vector and the dynamic process model- 

computing a current error covariance matrix of the state vector using a preceding error covariance 
matrix of the state vector, uncertainties associated with the dynamic process model, and the dynamic 
process model linearized about the current estimate of the state vector; 

computing a Kalman gain using the current covariance matrix, uncertainties associated with the 
20 dynamic measurement model, and the dynamic measurement model linearized about the current estimate of 

the state vector; 

computing a new error covariance matrix of the state vector using the current error covariance 
matrix of the state vector, the Kalman gain, and the dynamic measurement model linearized about the current 
estimate of the state vector; and 
25 computing a new best estimate of the state vector using the current estimate of the state vector, 

the Kalman gain, the measurement, and the dynamic measurement model. 

4. The method of Claim 1, wherein development of the dynamic process model and the dynamic 
measurement model is an iterative process comprising the acts of: 

defining estimation variables and uncertain parameters which become elements of the state vector; 
30 defining nominal time propagation of the estimation variables and the uncertain parameters; 

defining a nominal sensor measurement model- 
defining relationships between the estimation variables, the uncertain parameters, and the 
measurement; 

defining uncertainties associated with the estimation variables, the uncertain parameters, and the 
35 measurement; and 
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verifying a nominal dynamic process model and a nominal measurement model. 

5. The method of Claim 4, wherein a database of measurements is used to empirically verify the 
nominal dynamic process model and the nominal measurement model. 

6. The method of Claim 5, wherein the database has a plurality of sensor measurements with 

corresponding direct measurements. 

7. A real-time glucose estimator comprising: 

a plurality of measurement inputs, wherein at least one of the measurement inputs is configured to 

receive an input indicative of glucose level; 
a plurality of control inputs; and 

an extended Kalman filter algorithm configured to receive the plurality of measurement inputs and 
the plurality of control inputs to provide an optimal estimate of glucose level in real time. 

8. The real-time glucose estimator of Claim 7, wherein at least two independent glucose sensors are 

coupled to the measurement inputs respectively. 

9. The real-time glucose estimator of Claim 8, wherein at least two independent glucose sensors are 

of different types. 

10. The real-time glucose estimator of Claim 7, wherein at least one of the measurement inputs is 

configured to receive a direct measurement of glucose. 

11. The real-time glucose estimator of Claim 10, wherein the direct measurement is derived from a 

capillary blood glucose measurement. 

12. The real-time glucose estimator of Claim 7, wherein at least one of the control inputs is configured 

to receive configuration data. 

13. The real-time glucose estimator of Claim 7, wherein at least one of the control inputs is configured 

to receive environment data. 

14. The real-time glucose estimator of Claim 7. wherein the extended Kalman filter algorithm produces 
the optimal estimate of glucose level in real time using a recursive loop formed by a time update module and a 

measurement update module. 

15. The real-time glucose estimator of Claim 14, wherein the plurality of control inputs is processed in 

real time by the time update module. 

16. The real-time glucose estimator of Claim 14, wherein the plurality of measurement inputs is 

processed in real time by the measurement update module. 

17. The real-time glucose estimator of Claim 16, wherein measurement inputs of a substantially 
identical time interval are processed serially in one cycle of the measurement update module. 

18. The real-time glucose estimator of Claim 10, wherein the direct measurement is provided during 
initialization of the real time glucose estimator and intermittently thereafter. 
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19. The real-time glucose estimator of Claim 7, wherein at least one of the measurement inputs is 
provided periodically to the real-time glucose estimator. 

20. The real-time glucose estimator of Claim 7, wherein at least one of the measurement inputs is 
coupled to a non-invasive glucose sensor. 

5 21. The real-time glucose estimator of Claim 7 further comprising a patient health monitor configured 

to accept user inputs, to derive configuration data based on the user inputs, and to provide the configuration data in 
real time to the real-time glucose estimator. 

22. The real-time glucose estimator of Claim 7 further comprising a patient health monitor configured 
to display in real time the optimal estimate of glucose level and to provide an audible alarm when the optimal estimate 

1 0 of glucose level is outside a predetermined range. 

23. The real-time glucose estimator of Claim 10 further comprising a patient health monitor configured 
to display in real time a performance status for the real-time glucose estimator, wherein the performance status is 
based upon results of statistical testing performed on residuals of the extended Kalman filter. 

24. The real-time glucose estimator of Claim 23, wherein the patient health monitor outputs a request 
15 for the direct measurement of glucose when the performance status indicates the optimal estimate of glucose level is 

outside predetermined limits. 

25. An estimator for monitoring a physiological parameter comprising: 

a sensor which outputs a measurement as a function of the physiological parameter; 
an electronic processor coupled to an output of the sensor, wherein the electronic processor 
20 executes an algorithm that implements an extended Kalman filter to estimate the physiological parameter in 

real time; and 

an interface coupled to an output of the electronic processor to display the estimate of the 
physiological parameter in real time. 

26. The estimator of Claim 25, wherein the interface accepts user inputs and provides a control signal 
25 in real time to the electronic processor based on the user inputs. 

27. The estimator of Claim 26, wherein the user inputs describe environmental conditions of the sensor 
in real time. 

28. The estimator of Claim 26, wherein the user inputs describe activities of a patient using the 
estimator in real time. 

30 29. The estimator of Claim 26, wherein the user inputs describe real-time administration of medication 

to a patient using the estimator. 

30. The estimator of Claim 25, wherein the estimator is a portable device contained in a relatively small 
package and battery operated. 

31. An estimator comprising: 

35 means for obtaining a measurement related to a physiological parameter; and 
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means for processing the measurement in real time using a linearized Kalman filter algorhhm to 
provide a real-time estimate of the physiological parameter. 

32. The estimator of Claim 31 further comprising means for displaying the real-time estimate of the 

physiological parameter in real time. 
5 33. The estimator of Claim 31 further comprising means for updating the lineanzed Kalman filer 

algorithm in real time with user inputs. 

34. The estimator of Claim 31 further comprising means for indicating performance status of the 

estimator in real time. 

35. A method for controlling glucose level in real time comprising the acts of: 

10 receiving an estimated glucose level; 

receiving a reference signal indicative of a desired glucose level; 

providing the estimated glucose level and the reference signal to a Kalman control algorithm in real 

time; 

determining a control command in real time using the Kalman control algorithm; and 
15 providing the control command to a dispenser which outputs medication in response to the control 

command. m 

36. The method of Claim 35, wherein the estimated glucose level is provided by an opfmal estimator 

implemented using an extended Kalman filter. 

37. The method of Claim 35. wherein the reference signal is provided by a patient heahh momtor wh,ch 

20 accepts inputs from a user. 

38 The method of Claim 35, wherein the reference signal varies with time. 

3a The method of Claim 35, wherein the Kalman control algorithm has a dynamic process model 

forced by the control command and a cost function determining a relative level of control. 

40. The method of Claim 39, wherein determination of the control command in real time compnses the 

25 3cts of i 

computing a Kalman control gain to minimize the cost function; and 
adjusting the control command based on the Kalman control gain and a difference between the 
estimated glucose level and the desired glucose level. 

41. The method of Claim 35, wherein the dispenser secretes insulin or glucagon in response to the 
30 control command to correct a relatively high or a relatively low estimated glucose level. 

42. A method for close-loop control of a physiological parameter comprising the acts of: 
obtaining a measurement of the physiological parameter from a patient, 

providing the measurement to an optimal estimator in real time, wherein the optimal estimator 
outputs a best estimate of the physiological parameter in real time based on the measurements; 
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providing the best estimate of the physiological parameter to an optimal controller in real time, 
wherein the optimal controller outputs a control command in real time based on the best estimate of the 
physiological parameter and a control reference; and 

providing the control command to an actuator, wherein the actuator provides an output to adjust 
5 the physiological parameter. 

43. The method of Claim 42, wherein the measurement is obtained using a sensor. 

44. The method of Claim 42, wherein the optimal estimator is implemented using a linearized Kalman 
algorithm. 

45. The method of Claim 44, wherein the optimal controller is implemented using a Kalman control 
10 algorithm. 

46. The method of Claim 45, wherein the optimal estimator and the optimal controller have 
substantially identical dynamic process models forced by the control command. 

47. The method of Claim 46, wherein the optimal estimator provides a best estimate state vector to 
the optimal controller, and the best estimate of the physiological parameter is an element of the best estimate state 

15 vector. 

48. The method of Claim 46, wherein the optimal controller provides the control command to the 
optimal estimator. 

49. The method of Claim 42 wherein the optimal estimator and the optimal controller are implemented 
as a joint Kalman algorithm. 

20 50. The method of Claim 42, wherein the control reference is provided by a patient health monitor. 

51. The method of Claim 42, wherein the optimal estimator outputs best estimates of additional 
physiological parameters to the optimal controller in real time, and the optimal controller controls the additional 
physiological parameters by outputting additional control commands. 

52. A real-time optimal glucose controller comprising: 

25 a first input configured to receive an estimated glucose level in real time; 

a second input configured to receive a reference glucose level; 

a Kalman control algorithm configured to determine a control command based on the estimated 
glucose level and the reference glucose level, wherein the Kalman control algorithm has a dynamic process 
model forced by the control command and a cost function defining a desired level of control; and 
30 an output configured to provide the control command to a pump, wherein the pump provides 

medication in response to the control command to minimize a difference between the estimated glucose level 
and the reference glucose level. 

53. An artificial pancreas for controlling glucose level in real time comprising: 
a glucose sensor to provide a measurement of the glucose level; 
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an optimal glucose estimator, wherein the optimal glucose estimator uses a stochastic model to 
describe a physiological process relating to the glucose level and uses a linearized Kalman filter to estimate 
the glucose level in real time based on the measurement from the glucose sensor; 

an optima, glucose controller, wherein the optimal glucose controller uses a substantially identical 
5 stochastic model as the optimal glucose estimator and uses a Kalman centre, algorithm to determine a 

control command to adjust the glucose level in real time; and 

a medical dispenser to provide medication to a patient in response to the control command. 
54. The artificial pancreas of Claim 53, wherein the optimal glucose estimator and the optimal glucose 

controller are implemented using a software algorithm. 
10 55 The artificial pancreas of Claim 53. wherein the artificial pancreas is a portable device. 

56. The artificial pancreas of Claim 53 further comprising one or more additional sensors of different 
types which operate independently to provide respective glucose measurements. 

57. The artificial pancreas of Claim 53, wherein the medical dispenser secretes insulin and glucagon to 
control a relatively high glucose level and a relatively low glucose level respectively. 

15 58. The artificial pancreas of Claim 53 further comprising a patient health monitor with an input/output 

interface to receive inputs from a user and to display status of the artificial pancreas. 



20 



-32- 



WO 02/24065 PCT/USO 1/29649 



< 
< 



CN 



LU 



o 



O o£ 2 £ 
2 I I LU 



E 



< 



uj 

CO 

o 
o 

-J 

o 

Q 
O 
O 

I 

CD 

> 

< 



CL 
< 



2 LU 

O (/) 



en 
o 

CO 

z 

LU 
CO 

LU 
CO 

o 
o 



LU X C£ 

CD O l±J 

OK CO o 

ft: < ^ < h 

CL Q_ Or — I LU 



o 

LU 

go 

y CD 

or < 

h- 3 o 

<o£ 

P Z Z 
CO O o 
LU O O 



< 
CL 




CO 



O 



O 
IE 

X 
\ — 
I 

< 

LU 
X 

I— 

LU 

< 
CL 



CO 
— I 
< 
3 
Q 

CO 



CO 
LU 



UJ 
O 



< > 



CO 
LU 



CO 
h- 
3 
CL 



CO 




1/21 



WO 02/24065 



PCT/US01/29649 




2/21 



WO 02/24065 



PCT/USO 1/29649 




PCT/US01/29649 

WO 02/24065 




2: 








0 






CO 


ZATI 


CO 


CO 




UJ 


O CD 


q: 
0 


0 


pro 


1 


h- 


tr 


O . 


< 


0 










< 














• 


• 


• 



4/21 



WO 02/24065 PCT/USO 1/29649 



UJ 

I 

Q_ 

< 
X 
UJ 



UJ 

Q 

O 

m 

UJ 



< 

M 
— I 
< 



co 
cr 
z> 
o 

X 

o 
uj 



ID 

o 

X 

o 

UJ 

o 



CD 



O 

d 



CO 

*« 

I 



II 








o 








0) 


cn 


CO 




13 j 



o 
o 
o 



. CM 



^ o 



II 








O 










i ^ 


00 . 



o 
g x 

< x 

co 



o o 
d d 



il 



3 3 

cn CO 



O 
V- 

o 
z 

L_ 

C/) 
CO 
UJ 
O 
O 

q: 
a. 



x 

T3 



o 



CN 

£ o 
I I 



O ~ 



x° 



X 

i — 



UJ 

o 



a: 

§ 

o 
o 



o 

CL 



o 

CL 



O ^ 

o 
o 
o 

d 

CN 

8 o 



X 

< 

UJ 

CO 

o 



(7) 
CO 
UJ 

O 
O 
CE 
CL 

• 



O 



o 

N — ' 

a 



o 

CO 

Ul 
CO 



o 

CD 

O 



<N 



<N 

in 



a: 
o 

CO 

ui 

CO 



o 

CD 

o 



X 

< 



CO 

o 



UJ 

<r 

CO 

< 

Ul 

2 



in 



<N 

m 



01 



o 



UJ 

i= 

UJ 
— I 

3 



to 
< 

2 

CN 

T 

o 
o 

II 

« 

I 



< 

Q 
CL 

Ul 

o 



Si 



o 



o 

CL 



0C 



5/21 



WO 02/24065 



PCTYUS01/29649 




6/21 



WO 02/24065 



PCT/US01/29649 



bJ 

Q 
O 

m 

LU 

UJ 

I 

CL 

< 
X 
UJ 



< 

Q 
CL 
3 



LU 
LU 

CD 
< 
LU 







C£ 








o 








o 
























< 




(/) 




OC 




3 




O 




X 




o 




CM 




LU 
















LU 




CD 





o 

Z O 

~~ if) 

Q Z 

LU LU 



LU 
Q 

(/) 
LU 
O 

or 

< 



LU 
CD 
O 
01 
CL 



* 



I 0) 

„o < 

* to UJ 



CO 



+ 



Ll. 
LU 
Q 

m 
< 



a: 
+ 



i 

CL 



g 
in 

LU 

o 
en 

LU 
I— 

2: 

LU 
LU 

a: o 
co >- 



2 

< 
o 

< 

— I 

< 



CL 
II 



< 
UJ 



a 
< 



I 



P 



* 
+ 



1 a> 
X 



LU J- 



F ^ 

LU 



2 

CO 



X 



Q 
LU 

U. 
LU 
O 

in 
< 



i 

CL 

X 3 

PS £ 
< >^ 



LU 

O 

< 

or 

O 
o 



+ 

CL 



LU 

a 

< 

or 

LU 

£ 

CQ 



lu a 
q: o 

2 < 



o 

CQ 

O 

*J 

DC 
O 
CO 



in 

LU CO 

o o 

LU C£ 

Q LU 



< 
a 

CL 

ZD 

LU 



LU 

p < 
a: -> 



7/21 



WO 02/24065 



PCT/US01/29649 




8/21 



WO 02/24065 



PCT/US01/29649 




9/21 



WO 02/24065 



PCT/US01/29649 




10/21 



WO 02/24065 



PCT/US01/29649 




11/21 



WO 02/24065 



PCTAJS01/29649 



Ll. 
Lu 
< 
I— 



UJ 

< 
CL 



CO 
I— 


12 


NO 


3 




F 


CL 




< 


I— 


*g 


01 


JTS/OU 


ob 
op 


ONFIGU 
TROL 


INPL 


'IENT, 
INPU' 


OR C 
CON 
(FIG, 


FINE 


i — 


MAT 


UJ 




y- 


Q 


CO 


S3 

- 



CO 

2: 

LlI 
UJ 

CK 

O 

CO 

\ 

CO 

>- 
< 



ul CO CO , 

ujpy o 

I— ^ 
CO 



T 









o 








< 












O 




Uu 




2: 




o 




o 




etc 




O _j 




£ o 


CO 


< a: 


h- 


5h 


X 


P z 


o 


0)0 


— 1 


Ui O 


• 


• 



<■ to 



< 
q 

CO 
UJ 

o: 

i— o 

ui co rr 

LU 
O 



3 



F v> 1 
V) < 

UJ uj 



12/21 



WO 02/24065 PCT7US0 1/29649 



LU 



< 
Q 
CL 
3 



CO 
LU 



2 
LU 

LU 
CC 
3 
CO 
< 
LU 



O 



+ 
CL 











II 












CO 




00 




AL 


7 


3 




O 




CO 


c/) 


LU 




C£ 


II 


U- 




o 










CO 






CO 





CO 

< 



CO 
I 

< 

3 
Q 

CO 
LU 

a: 

Lu 

o 



3 

CO 

o 



< 

> 



o 

CO 
CD 
< 



CO 



CO 

< 



^> C£ 



lu a. 

g s 

< X 
CH „ 

5 ' 



< 

3 

q 
c/) 

LU 

a: 



J* P 

CL 
O 



II 



3 
CO 



a: 
o 

Lu 



co o 

vO u 

00 + 

-J <^-s 

< v-^ 

9 i 

CO ^ 

LU 



CO 



o o 

of 

II 



o 3 

LU ^ 

O 00 

§ I 

a: ^ 

< 

> 



CO 



Lu 
O 



o 

< 
> 

UJ 
Q 

Q 

a: 
< 

Q 

< 
co 
• 



6? 



ft 

00 



2 

I — 

o 

LU 

CL 
V) 
LU 

cr 
o 



z> 

Q 
LU 
LU 

< 

LU 

LU 
O 



O 

O 
CD 



< 
X 
LU 

DC 
O 



< 
Q 

h- 

o 



13/21 



PCT7US01/29649 

WO 02/24065 



< 



CO 



< 
3 
Q 

co 

UJ 
Ql 



< 
— 1 

CL 

co 
o 

o 

1 

CL 

>- 

g 

</> 
X 

UJ 



< 
9 

CO 
LU 

U. 

o 



CO 



< 

3 
Q 
CO 
UJ 
01 



UJ 

3 

I 

< 
> 



o 
if) 

CD 
< 



CO 
I 

< 

3 
Q 

CO 
UJ 
Ol 

UJ 
X 



3 
CO 

UJ 
X 



u. 
o 

UJ 
3 

I 

< 
> 

UJ 
h- 
3 

I 

O 
CO 
CD 
< 



3 
O 

UJ 

h- 

Ul 

o 

CO 
Q 

01 
O 

>- 
01 

o 
h- 
co 



UJ 



UJ 
— I 
CD 
< 
V— 
0. 
UJ 

o 
o 
< 

UJ 

o 



oc: 
o 
u_ 

01 
UJ 
CL 

01 

o 



CO 
UJ 



CO UJ 



CO 
UJ 
X 
I— 

o 

8= 

X 



Ul 

I 

CD 
< 

CL 
UJ 
O 

o 
< 

3 



O 

< 

01 

o 

to- 
ol 
LJ 
CL 

01 
O 

< 



o 

CL 
>- 
X 

I 



CO 
UJ 



CO 
CO 



o 

CL 
> 
X 



3 
0. 
h- 
3 
O 

UJ 
I— 
Ul 
01 
O 



01 

o 
>- 

01 

o 



< 
> 

01 
Ul 



00 
X 



Q 
UJ 
U- 

O 
Ul UJ 
^ CL 
^ CO 



if) j± 
UJ ^ 



< 
> 

01 



Ui 

o 
< 

01 

o 



a 2 



UJ 

9 
u. 
z 
o 
o 



CL 



CO 
UJ 



< 

01 

o 
o 
o 

X 

-1 

Ul 



3 
CL 
V- 
3 

o 



3 
CL 



01 
O 



o 



< 

UJ 
X 



14/21 



WO 02/24065 PCT/USO 1/29649 




15/21 



WO 02/24065 



PCTYUS01/29649 



O 




16/21 



WO 02/24065 



PCT/US01/29649 




WO 02/24065 



PCT/US01/29649 



U_ 
Ll. 
< 



2: 
uj 

< 
CL 



o 



CL 



LL 




P 




1 




z 




0 












X 












< 


O 


UJ 


Lu 


X 








z: 




„ UJ 








< 




CL 





t— 



3°- 

O _l 

,0 

tz a: 
z i— 

y z 
1-0 

< o 

CL 




NX 




UJ 




F= 




< 




Q_ 







0 s 




CD 




C) 


CD 


U_ 


CD 






cr 


d 


UJ 


Lu 

' — s 


) 

1 




0 


-J 


cr 


UJ 


1— 


O 




O 


0 




0 


UJ 
1 


UJ 

1 


CL 


CL 






< 


< 


X 


X 


UJ 


UJ 


• 


• 




18/21 



WO 02/24065 PCT/US01/29649 




19/21 



PCT/US01/29649 

WO 02/24065 



LU 
O 
O 



CO 
UJ 
CO 

co 

Lu 

o 
o 

q_ 

o 



< 

>- 
o 



1 Q 
CD 

i 


o 


i 

o 


+ 


1 


co 


i 





1 ' 

CP 
CD 


o 


1 

Q 

1 


O 


in 

1 


o 


S 
1 1 


o 


o 

1 


ii 


1 • 

X) 


0) 

CO 


«' 

Q 




CD 



ii 

1-0 



« 



Q> 
II 

tO 

to 
o 



to 
sz 

z?8 



o 

CM 



Al 



II 

cm 

CM 

o 



X 



2: 
o 

< 

C£ 



CM 
IO 
O 



to 
o 



to 

CM 
O 



CM 

o 

II 

CM 

T — 

o 



1 

to 

T — 

Q 


to 

CM 

o 


1 

to 
to 
Q 


CM 

o 


CM 
CM 
O 


CM 

to 
o 


t — 


T 

CM 

O 


1 

to 

°l 


II 

< 



o 
o 

I — I 

II 

I 

cn 
I 

Cn 



Cn 
I 

X 

o 



01 
O 
o: 
ce 

UJ 

Q 
UJ 
— I 
I 

o 



o 
o 



o 
o 



Q 
CD 



II 

CD 

i 

of 



o 
< 



o 

o 



o 



o 
o 



o 
o 



CM 

X 



cn 



0) 

CO 



X 

00 

2: 

UJ 

UJ 

DC 
3) 
CO 
< 
Ul 



CM O 

cn 



UJ 



o 

I — 

o 
r> 

U- 




CO 

O 
o 



CO 

o 
o 



Q 

< 



cn 



C£ 
O 
C£ 
CE 
UJ ^ 

Q 8 

o o 
o o 



if) 

(/) 
o 
o 



20/21 



WO 02/24065 PCT/USO 1/29649 



> 

if) 
Z 
UJ 



3 

N — ✓ 
u 



O 

£ 

Z> 
CL 

O 

o 

< 
o 

I 

o 
ce 
i— 
z 
o 
o 
• 



>- 

I 

I 

< 
z 
o 

< 



CL 

o 
o 

o 

>- 

5 



Q 
UJ 
h- 

Q_ 

O 
O 

iL 

C£ 
CL 

LlT 
< 

>• 

< 
UJ 



UJ 



O 
< 



O 

o 



o 



o 
o 



CL 



3 
CD 
+ 



X 



< 
II 

+ 



o 



o 
o 

CL 

o 
o 

I 

Q 
UJ 

tn 
o 

— I 

o 





O 


o . 


+ 














0) 

L °* 








rO 

6" 


o 


ro 
O 


o 




O 


T 

i 


o 


O 

i 


II 


i 






+ 


+ 


+ 








1 


CO 





21/21 



INTERNATIONAL SEARCH REPORT 



Into, Application No 

PCT/US 01/29649 



I A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 A61B5/00 



According lo Inlernatlor.a. Paten; Classiflcatton (IPC) ~ to bog; nallona. Cassation and .PC 
- L^cume^n searched (das^ticaHon system fdlowed By Cassmcatlon symbols) 

IPC 7 A61B 



EPO-Internal , INSPEC, WPI Data 



C. nriCUMENTS CONSIDERED TO BE RELEVANT 



Category 0 



Citation 



of document, with indication, where appropriate, of the relevant passages 



WU X ET AL- "Fast on-Hne data evaluation 
of flow-injection analysis signals based 
on parameter estimation by an extended 

jSNAL f OF t6 BIOTECHN0L06Y, ELSEVIER SCIENCE 

PUBLISHERS, AMSTERDAM , NL 

vol 62, no. 1, U Oune 1998 (1998-06-11), 

pages 11-28, XP004127150 

ISSN: 0168-1656 

page 26, right-hand column, line 9 - 12 
page 13-21, sections 2.1 and 2.2 

-/-- 



I QD Further documents are 15sted m the continuation of box c ' 

■ Special categories of cited documents : 

•A" document defining the general state of the art which is not 
I considered to be of particular relevance 

'E' earlier document but published on or after the international 
i filing date . 

■L' document which may throw doubts on g^^^S^LSL 
' Which is cited to establish the pubUcation date of another 
citation or other special reason (as specified) 
•O' document referring to an oral disclosure, use, exhibition or 

other means ■ 
V document published prior to the international filing date dux 
later than the priority date claimed 

Date of the actual completion of the international search 

20 February 2002 

i Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NL - 2280 HV Rijswijk ^ ^ . 
Tel. (+31-70) 340-2040, Tx. 31 651 epo nl, 
Fax: (+31-70) 340-3016 



Form PCT/1SA/210 (second sheet) (July 1992) 



Relevant to claim No. 

1-4,7, 
10,12, 
14,19,20 



5,15-18 



ID 



Patent family members are listed in annex. 



rri i a ter document published after the International filing date 
T TpriorfS Tdate P and not in conflict with the applfc^on but 
cited to understand the principle or theoiy underlying the 
Invention 

•X' document of particular relevance; the claimed invention 
SE3 ^considered novel or cannot be considered to 
Me an inventive step when the document is taken atone 
•Y» document of particular relevance; the claimed invention 
^ d S be Kderedtolnvolve an inwntlve > Mgnlta 
document Is combined with one or more other j ali- 
ments, such combination being obvious to a person stalled 
in the art. 

document member of the same patent family 



Date of mailing of the International search report 

07/03/2002 

Authorized officer 

Kniipling, M 



page 



1 of 2 



INTERNATIONAL SEARCH REPORT 



Inte al Application No 

PCT/US 01/29649 



C(Contlnuatlon) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



WOODRUFF E A ET AL: "The closed-loop 
regulation of blood glucose 1n diabetics" 
PROCEEDINGS OF THE FOURTEENTH ANNUAL 
NORTHEAST BIOENGINEERING CONFERENCE (IEEE 
CAT. N0.88-CH2666-6), DURHAM, NH, USA, 
10-11 MARCH 1988, 

pages 54-57, XP010078511 
1988, New York, NY, USA, IEEE, USA 
the whole document 



PARKER R S ET AL: "Model predictive 
control for infusion pump Insulin 
delivery" 

PROCEEDINGS OF THE 18TH ANNUAL 
INTERNATIONAL CONFERENCE OF THE IEEE 
ENGINEERING IN MEDICINE AND BIOLOGY 
SOCIETY. 'BRIDGING DISCIPLINES FOR 
BIOMEDICINE' (CAT. N0.96CH36036), 
PROCEEDINGS OF 18TH ANNUAL INTERNATIONAL 
CONFERENCE OF THE IEEE ENGINEERING I, 
pages 1822-1823 vol.5, XPOO2190918 
1997, New York, NY, USA, IEEE, USA 
ISBN: 0-7803-3811-1 

page 1822, right-hand column, line 10 - 30 
page 1823, left-hand column, line 16 - 37 



WO 97 28737 A (NOKIA MOBILE PHONES LTD; 
OKKONEN HARRI (FI); HEINONEN PEKKA (FI)) 
14 August 1997 (1997-08-14) 
page 7, line 21 - line 34 
page 10, line 24 

page 11, line 5 -page 12, line 11 

WO 99 56613 A (GAL YORAM; TOMASCO MICHAEL 
F (US); ARIA BEHRAD (US); HELLER ADAM) 
11 November 1999 (1999-11-11) 
page 39, line 16 - line 19 
page 49, line 15 - line 16 
page 51, line 22 -page 52, line 16 
page 56, line 33 -page 57, line 24 
page 70, line 26 - line 27 

WO 00 15102 A (EPPSTEIN JONATHAN A; 
SPECTRX INC (US); HATCH MICHAEL R (US); 
MCRAE) 23 March 2000 (2000-03-23) 
page 7, line 16 - line 26 
page 8, line 11 -page 9, line 13 



1-4, 

25-33, 

52-55,57 



7,10-24, 
34,58 

25-33, 
52-55,57 



1-3,7, 
10-24, 
34,58 

1,4,5,7, 

25,31, 

52,53 



1,7-13, 

19-25, 

31,52-58 



1,7,25, 
31,52,53 



Form PCT/lSA/210 (continuation of second sheat) (July 1992) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



Patent document 
cited In search report 



Publication 
date 



WO 9728737 



14-08-1997 FI 
AU 
DE 
DK 
EP 
WO 
OP 
US 



WO 9956613 



11-11-1999 US 
AU 
EP 

WO 



WO 0015102 



23-03-2000 



AU 
EP 
WO 
AU 
BR 
EP 
WO 



Inter * Application No 

PCT/US 01/29649 



patent family 
member(s) 



960637 A 
1726797 A 
69707266 Dl 
883371 T3 
0883371 Al 
9728737 Al 
2000503556 T 
5840020 A 



6175752 Bl 
2330799 A 
1075209 Al 
9956613 Al 



3510701 A 
1112021 Al 
0015102 Al 
5004299 A 
9912333 A 
1098594 Al 
0004832 Al 



Publication 
date 



13- 08-1997 
28-08-1997 

15- 11-2001 
28-01-2002 

16- 12-1998 

14- 08-1997 
28-03-2000 
24-11-1998 



16- 01-2001 
23-11-1999 
14-02-2001 
11-11-1999 

03- 01-2002 

04- 07-2001 
23-03-2000 
14-02-2000 

17- 04-2001 
16-05-2001 
03-02-2000 



Foim PCT/ISA/210 (patent family annex) (July 1992) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: ; . 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



WW***"* 



